Asynchronous Training of Word Embeddings for Large Text Corpora

Word embeddings are a powerful approach for analyzing language and have been widely popular in numerous tasks in information retrieval and text mining. Training embeddings over huge corpora is computationally expensive because the input is typically sequentially processed and parameters are synchronously updated. Distributed architectures for asynchronous training that have been proposed either focus on scaling vocabulary sizes and dimensionality or suffer from expensive synchronization latencies. In this paper, we propose a scalable approach to train word embeddings by partitioning the input space instead in order to scale to massive text corpora while not sacrificing the performance of the embeddings. Our training procedure does not involve any parameter synchronization except a final sub-model merge phase that typically executes in a few minutes. Our distributed training scales seamlessly to large corpus sizes and we get comparable and sometimes even up to 45% performance improvement in a variety of NLP benchmarks using models trained by our distributed procedure which requires $1/10$ of the time taken by the baseline approach. Finally we also show that we are robust to missing words in sub-models and are able to effectively reconstruct word representations.Comment: This paper contains 9 pages and has been accepted in the WSDM201

The Gattini cameras for optical sky brightness measurements at Dome C, Antarctica

The Gattini cameras are two site testing instruments for the measurement of optical sky brightness, large area cloud cover and auroral detection of the night sky above the high altitude Dome C site in Antarctica. The cameras have been operating since installation in January 2006 and are currently at the end of the first Antarctic winter season. The cameras are transit in nature and are virtually identical both adopting Apogee Alta CCD detectors. By taking frequent images of the night sky we obtain long term cloud cover statistics, measure the sky background intensity as a function of solar and lunar altitude and phase and directly measure the spatial extent of bright aurora if present and when they occur. The full data set will return in December 2006 however a limited amount of data has been transferred via the Iridium network enabling preliminary data reduction and system evaluation. An update of the project is presented together with preliminary results from data taken since commencement of the winter season

Evolution of dynamic, biochemical, and morphological parameters in hypothermic machine perfusion of human livers: A proof-of-concept study

Introduction: Hypothermic machine perfusion (HMP) is increasingly investigated as a means to assess liver quality, but data on viability markers is inconsistent and the effects of different perfusion routes and oxygenation on perfusion biomarkers are unclear. Methods: This is a single-centre, randomised, multi-arm, parallel study using discarded human livers for evaluation of HMP using arterial, oxygen-supplemented venous and non-oxygen-supplemented venous perfusion. The study included 2 stages: in the first stage, 25 livers were randomised into static cold storage (n = 7), hepatic artery HMP (n = 10), and non-oxygen-supplemented portal vein HMP (n = 8). In the second stage, 20 livers were randomised into oxygen-supplemented and non-oxygen-supplemented portal vein HMP (n = 11 and 9, respectively). Changes in dynamic, biochemical, and morphologic parameters during 4-hour preservation were compared between perfusion groups, and between potentially transplantable and non-transplantable livers. Results: During arterial perfusion, resistance was higher and flow was lower than venous perfusion (p = 0.001 and 0.01, respectively); this was associated with higher perfusate markers during arterial perfusion (p>0.05). Supplementary oxygen did not cause a significant alteration in the studied parameters. Morphology was similar between static and dynamic preservation groups. Perfusate markers were 2 fold higher in non-transplantable livers (p>0.05). Conclusions: Arterial only perfusion might not be adequate for graft perfusion. Hepatocellular injury markers are accessible and easy to perform and could offer insight into graft quality, but large randomised trials are needed to identify reliable quality assessment biomarkers

A Comparison of Maps and Power Spectra Determined from South Pole Telescope and Planck Data

We study the consistency of 150 GHz data from the South Pole Telescope (SPT) and 143 GHz data from the Planck satellite over the patch of sky covered by the SPT-SZ survey. We first visually compare the maps and find that the residuals appear consistent with noise after accounting for differences in angular resolution and filtering. We then calculate (1) the cross-spectrum between two independent halves of SPT data, (2) the cross-spectrum between two independent halves of Planck data, and (3) the cross-spectrum between SPT and Planck data. We find the three cross-spectra are well-fit (PTE = 0.30) by the null hypothesis in which both experiments have measured the same sky map up to a single free calibration parameter---i.e., we find no evidence for systematic errors in either data set. As a by-product, we improve the precision of the SPT calibration by nearly an order of magnitude, from 2.6% to 0.3% in power. Finally, we compare all three cross-spectra to the full-sky Planck power spectrum and find marginal evidence for differences between the power spectra from the SPT-SZ footprint and the full sky. We model these differences as a power law in spherical harmonic multipole number. The best-fit value of this tilt is consistent among the three cross-spectra in the SPT-SZ footprint, implying that the source of this tilt is a sample variance fluctuation in the SPT-SZ region relative to the full sky. The consistency of cosmological parameters derived from these datasets is discussed in a companion paper.Comment: 15 pages, 9 figures. Published in The Astrophysical Journal. Current arxiv version matches published versio

Extragalactic millimeter-wave point source catalog, number counts and statistics from 771 square degrees of the SPT-SZ Survey

We present a point source catalog from 771 square degrees of the South Pole Telescope Sunyaev Zel'dovich (SPT-SZ) survey at 95, 150, and 220 GHz. We detect 1545 sources above 4.5 sigma significance in at least one band. Based on their relative brightness between survey bands, we classify the sources into two populations, one dominated by synchrotron emission from active galactic nuclei, and one dominated by thermal emission from dust-enshrouded star-forming galaxies. We find 1238 synchrotron and 307 dusty sources. We cross-match all sources against external catalogs and find 189 unidentified synchrotron sources and 189 unidentified dusty sources. The dusty sources without counterparts are good candidates for high-redshift, strongly lensed submillimeter galaxies. We derive number counts for each population from 1 Jy down to roughly 9, 5, and 11 mJy at 95, 150, and 220 GHz. We compare these counts with galaxy population models and find that none of the models we consider for either population provide a good fit to the measured counts in all three bands. The disparities imply that these measurements will be an important input to the next generation of millimeter-wave extragalactic source population models.Comment: 23 pages, 8 figures, submitted to Ap

A Measurement of the Cosmic Microwave Background Damping Tail from the 2500-square-degree SPT-SZ survey

We present a measurement of the cosmic microwave background (CMB) temperature power spectrum using data from the recently completed South Pole Telescope Sunyaev-Zel'dovich (SPT-SZ) survey. This measurement is made from observations of 2540 deg$^2$ of sky with arcminute resolution at $150\,$GHz, and improves upon previous measurements using the SPT by tripling the sky area. We report CMB temperature anisotropy power over the multipole range $650<\ell<3000$. We fit the SPT bandpowers, combined with the seven-year Wilkinson Microwave Anisotropy Probe (WMAP7) data, with a six-parameter LCDM cosmological model and find that the two datasets are consistent and well fit by the model. Adding SPT measurements significantly improves LCDM parameter constraints; in particular, the constraint on $\theta_s$ tightens by a factor of 2.7. The impact of gravitational lensing is detected at $8.1\, \sigma$, the most significant detection to date. This sensitivity of the SPT+WMAP7 data to lensing by large-scale structure at low redshifts allows us to constrain the mean curvature of the observable universe with CMB data alone to be $\Omega_k=-0.003^{+0.014}_{-0.018}$. Using the SPT+WMAP7 data, we measure the spectral index of scalar fluctuations to be $n_s=0.9623 \pm 0.0097$ in the LCDM model, a $3.9\,\sigma$ preference for a scale-dependent spectrum with $n_s<1$. The SPT measurement of the CMB damping tail helps break the degeneracy that exists between the tensor-to-scalar ratio $r$ and $n_s$ in large-scale CMB measurements, leading to an upper limit of $r<0.18$ (95%,C.L.) in the LCDM+$r$ model. Adding low-redshift measurements of the Hubble constant ($H_0$) and the baryon acoustic oscillation (BAO) feature to the SPT+WMAP7 data leads to further improvements. The combination of SPT+WMAP7+$H_0$+BAO constrains $n_s=0.9538 \pm 0.0081$ in the LCDM model, a $5.7\,\sigma$ detection of $n_s < 1$, ... [abridged]Comment: 21 pages, 10 figures. Replaced with version accepted by ApJ. Data products are available at http://pole.uchicago.edu/public/data/story12

Consistency of cosmic microwave background temperature measurements in three frequency bands in the 2500-square-degree SPT-SZ survey

We present an internal consistency test of South Pole Telescope (SPT) measurements of the cosmic microwave background (CMB) temperature anisotropy using three-band data from the SPT-SZ survey. These measurements are made from observations of ~2500 deg^2 of sky in three frequency bands centered at 95, 150, and 220 GHz. We combine the information from these three bands into six semi-independent estimates of the CMB power spectrum (three single-frequency power spectra and three cross-frequency spectra) over the multipole range 650 < l < 3000. We subtract an estimate of foreground power from each power spectrum and evaluate the consistency among the resulting CMB-only spectra. We determine that the six foreground-cleaned power spectra are consistent with the null hypothesis, in which the six cleaned spectra contain only CMB power and noise. A fit of the data to this model results in a chi-squared value of 236.3 for 235 degrees of freedom, and the probability to exceed this chi-squared value is 46%.Comment: 21 pages, 4 figures, current version matches version published in JCA

Rad51 Interacts with Non-structural 3 Protein of Hepatitis C Virus and Regulates Viral Production

Hepatitis C virus (HCV) is a leading cause of chronic liver disease affecting over 170 million people worldwide. Chronic infection with HCV progresses to liver fibrosis, cirrhosis, and hepatocellular carcinoma. HCV exploits host cellular factors for viral propagation. To investigate the cellular factors required for HCV propagation, we screened a siRNA library targeting human cell cycle genes using cell culture grown HCV-infected cells. In the present study, we selected and characterized a gene encoding Rad51. Rad51, a member of a conserved recombinase family, is an essential factor for homologous recombination and repair of double-strand DNA breaks. We demonstrated that siRNA-mediated knockdown of Rad51 significantly inhibited HCV propagation without affecting HCV RNA replication. Silencing of Rad51 impaired secretion of infectious HCV particles and thus intracellular viruses were accumulated. We showed that HCV NS3 specifically interacted with Rad51 and accumulated Rad51 in the cytosol. Furthermore, Rad51 was coprecipitated with NS3 and HCV RNA. By employing membrane flotation and protease protection assays, we also demonstrated that Rad51 was co-fractionated with HCV NS3 on the lipid raft. These data indicate that Rad51 may be a component of the HCV RNA replication complex. Collectively, these data suggest that HCV may exploit cellular Rad51 to promote viral propagation and thus Rad51 may be a potential therapeutic target for HCV